Source-target relations mapping

ABSTRACT

A data preservation function is provided which, in one embodiment, includes mapping in a plurality of maps for a target storage device, map extent ranges of each map, to corresponding target extent ranges of storage locations on the target storage device. Usage of a particular map extent range by a relationship between a source extent range of storage locations on a source storage device containing data to be preserved in the source extent range, and the target extent range mapped to the map particular extent range, may be indicated by the map. In another aspect, in response to receipt of a data preservation command, a data preservation operation is performed including determining whether a map indicates availability of a map extent range mapped to the identified target extent range. Upon determining that a particular map indicates availability of a map extent range mapped to the identified target extent range, a relationship between the identified source extent range and the identified target extent range is established. In yet another aspect, upon determining that no map indicates availability of a map extent range mapped to the identified target extent range, establishing of a relationship between the identified source extent range and the identified target extent range may be delayed until it is determined that a particular map indicates availability of a map extent range mapped to the identified target extent range. Other features and aspects may be realized, depending upon the particular application.

BACKGROUND

1. Field

The present description relates to a method, system, and computerprogram for mapping source-target relationships in a storage areanetwork.

2. Description of Related Art

One or more hosts may store large quantities of data in a group ofstorage units, which is typically controlled by a storage controller. Anexample of such a storage controller is the IBM TotalStorage® EnterpriseStorage Server® (ESS). A storage controller such as the ESS may providea number of functions accessible by the hosts for protecting data,backing up the data, and making the data available for use.

Amongst the functions which may be provided by a storage controller is adata preservation function which can preserve an identified set of dataat a particular point in time. For example, the ESS storage controllersupports a data preservation function referred to as “FlashCopy” whichenables a copy to be made of a set of tracks in a source volume. Onefeature of such data preservation functions is that the data of the copyis frequently made immediately available for read or write access. Theidentified data may be for example, a set of tracks which can consist ofan entire volume, a data set, or just a selected set of tracks, forexample.

In one mode of a data preservation function, a copy of all of the datato be preserved at the particular point in time, is made by copying theidentified data from identified tracks of the source volume toidentified tracks of the target volume, typically in a background copymode. In this manner, a relationship is established between thoseidentified tracks on the source volume and corresponding tracks on thetarget volume, in response to a data preservation request. The datapreservation relationship may be initiated in response to the datapreservation request and may be terminated and deleted when thebackground copy completes or in response to a withdrawal command.

However, for some data storage operations, copying all of the data to bepreserved at a point in time may not be suitable. For example, somestorage units are configured for improved data storage efficiency.Examples of efficiency configurations include the “Track SpaceEfficient” and “Extent Space Efficient” volume configurations often usedin ESS data storage systems. A track “extent” typically contains abeginning track, an ending track, and all the tracks between thebeginning track and the end track.

In such volume efficiency configurations, a different mode of operationmay be used for a data preservation function. For example, instead ofcopying all of the data to be preserved at a point in time, a “block onwrite” paradigm may be followed.

As noted above, the data preservation relationship may be initiated inresponse to a data preservation request and may end when the backgroundcopy completes or in response to a withdrawal command. There are variousreasons for withdrawing a FlashCopy relationship. For example, theremight no longer be a need for the FlashCopy relationship. In those andother situations, the withdrawal command may be used to delete therelationship between the source and target.

In many prior storage systems, a relationship may be deleted or removedimmediately in response to a withdrawal command. Hence, a newrelationship which encompasses tracks of a prior relationship mayfrequently be rapidly established in such systems following a withdrawalcommand of the prior relationship.

SUMMARY

A data preservation function is provided which, in one embodiment,includes mapping in a plurality of maps for a target storage device, mapextent ranges of each map, to corresponding target extent ranges ofstorage locations on a target storage device. Indicated for a particularmap extent range of a particular map, is usage of the particular mapextent range by a relationship between a source extent range of storagelocations on a source storage device containing data to be preserved inthe source extent range, and the target extent range mapped to the mapparticular extent range.

In another aspect, in response to receipt of a data preservation commandfor an identified source extent range containing data to be preserved onthe source storage device, and an identified target extent range on thetarget storage device, a data preservation operation may be performedincluding determining whether a map indicates availability of a mapextent range mapped to the identified target extent range. Upondetermining that a particular map indicates availability of a map extentrange mapped to the identified target extent range, a relationshipbetween the identified source extent range and the identified targetextent range is established. In addition, usage of the particular mapextent range of the particular map by the relationship may be indicatedby the map.

In one embodiment, an identification of the particular map may be storedin a data structure for the relationship, such that the data structurecan indicate usage of the particular map extent range of the particularmap by the relationship.

In another aspect, upon determining that no map indicates availabilityof a map extent range mapped to the identified target extent range,establishing of a relationship between the identified source extentrange and the identified target extent range may be delayed until it isdetermined that a particular map indicates availability of a map extentrange mapped to the identified target extent range.

In some embodiments, upon withdrawing a relationship, data within theidentified target extent range of the withdrawn relationship, may becopied to older relationships inheriting the data being copied. Uponcompletion of the copying of data within the identified target extentrange of the withdrawn relationship, to older relationships inheritingthe data being copied, it may be indicated that the particular mapextent range of the particular map, is available for usage by anotherrelationship between a source extent range of storage locations on asource storage device containing data to be preserved in the sourceextent range, and the target extent range of the withdrawn relationship.

Other features and aspects may be realized, depending upon theparticular application.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates operations of a prior art data preservation functionin an “all copy” mode of operation.

FIGS. 2 a-2 e illustrate operations of another prior art datapreservation function in a “no copy” mode of operation.

FIG. 3 illustrates an embodiment of a computing environment in which anaspect of the present description may be employed.

FIGS. 4 a-4 h illustrate examples of a table of bitmaps in connectionwith operations of a data preservation function in accordance with oneembodiment of the present description.

FIG. 5 illustrates examples of events in connection with operations of adata preservation function in accordance with one embodiment of thepresent description.

FIG. 6 illustrates an example of operations of a relationshipestablishing function in accordance with one embodiment of the presentdescription.

FIG. 7 illustrates an example of data structures for use with operationsof a relationship establishing function in accordance with oneembodiment of the present description.

FIG. 8 illustrates an example of operations of relationship withdrawaland deletion functions in accordance with one embodiment of the presentdescription.

DETAILED DESCRIPTION

It is appreciated that there may be storage systems in which there canbe delays in completing the deletion of a relationship in response to awithdrawal command. For example, data may need to be copied from thetarget before the relationship is permitted to be deleted or removed inresponse to withdrawal of that relationship. As a consequence, in somesystems, establishment of a new relationship which encompasses tracks ofa prior relationship may be delayed until withdrawal of the priorrelationship is completed and the prior relationship is deleted.

In accordance with one aspect of the present description, and asexplained in greater detail below, by providing a plurality of maps fora target storage device, in which each map, maps extent ranges of themap to corresponding target extent ranges of storage locations on thetarget storage device, a new relationship which encompasses tracks of aprior relationship may be initiated before deletion of the withdrawnprior relationship is completed. As a consequence, reduction orelimination of delays in establishing of new relationships may befacilitated.

FIG. 1 illustrates one example of one mode of operation of a prior artdata preservation function, referred to herein as an “all copy” mode, inwhich a copy of all of the data to be preserved at a point in time, ismade by copying the identified “point-in-time” data from a source volume100 to a target volume 110, typically in a background copy mode. Thesource volume 100 and the target volume 110, as well as the set of datato be preserved, are typically identified in a data preservationrequest.

The point-in-time data to be preserved on the source volume 100 resideson particular tracks, indicated at 120 in FIG. 1. In one prior artdevice, a relationship 130 is established between those identifiedtracks 120 on the source volume 100 and corresponding tracks 140 on thetarget volume 140, in response to a data preservation request. Thesource tracks 120 for the point-in-time data to be preserved may residein one or more track extents, each of which contains a beginning track,an ending track, and all the tracks between the beginning track and theend track.

In one prior art device, a contiguous set of source tracks related to acontiguous set of target tracks is referred to as a “track set.” Eachtrack set provides a data preservation relationship 130. In some priorart devices, a track set is described in terms of a source track extentand a target track extent. Thus one or more tracks may be identified tobe preserved but each track set may require a source extent and a targetextent in some prior art devices. The data preservation relationship 130begins in response to a data preservation request and ends when thebackground copy completes or in response to a withdrawal command.

As previously mentioned, in the “all copy” mode of the data preservationfunction depicted in FIG. 1, all tracks in the relationship 130 arephysically copied from the source volume tracks 120 to the target volumetracks 140. In some prior art devices, the source tracks 120 are copiedto the target volume 110 in the same track locations within the targetvolume 110 as the source tracks 120 within the source volume 100. Inother prior devices, source tracks 120 may be copied to the targetvolume 110 in track locations specified in the data preservationfunction request.

As soon as the relationship 130 is established, user programs haveaccess to two logical copies of the source data. Access to thepoint-in-time copy of the data on the source volume 100 is throughreading the data from the target volume 110. Data that is read from thetarget storage device returns source track data from the point-in-timeof the establishment of the “all copy” mode relationship 130. Access tothe point-in-time data is provided without waiting for the copying ofthe point-in-time data to the target storage device to complete. If thepoint-in-time data requested from the target storage device has not yetbeen physically copied to the target volume 110, the point-in-time datais obtained from the source volume 100.

The data preservation relationship 130 ends for each track set when itis copied to the target volume 110. After the background copy iscomplete, the point-in-time data on the target storage device is thesame as the point-in-time data on the source storage device when thedata preservation relationship 130 was first established. However, ifdata is written to a track that is a target track that was in the datapreservation relationship 130, a read to the updated target trackreturns the user-updated data, and not the point-in-time source trackdata. Thus, target tracks are withdrawn from the data preservationrelationship 130 as soon as any application writes to these tracks.Similarly, updates to the source volume after the relationship 130 isestablished are not part of the point-in-time copy on the target storagedevice.

In some prior art devices, it is a requirement of the data preservationfunction that the entire source volume and target volume be involved inthe data preservation relationship, even if selected tracks werespecified in the data preservation request or command.

FIGS. 2 a-2 e illustrate one example of another mode of operation of aprior art data preservation function for point-in-time data inconnection with a source storage device 200 (FIG. 2 a) and a targetstorage device 210. In this example, the data preservation functionestablishes a data preservation relationship 230 (FIG. 2 b) for a trackset of the source storage device 200 and the target storage device 210without immediately initiating a physical copy of point-in-time datafrom the source storage device 200 to the target storage device 210.Hence, this mode is referred to as a “no copy” mode. The “no copy” modeof a data preservation function is useful in those applications wherespace efficiency is emphasized.

In the example of FIGS. 2 a-2 e, the point-in-time data on the sourcestorage device 200 is stored on source tracks represented by tracks 250a, 250 b, 250 c. In establishing the relationship 230, a set of spacecomparable to that occupied by the identified point-in-time data of thesource storage device 200, is made available on the target storagedevice 210 and is of sufficient size such that it can hold on the targetstorage device 210 the entire set of point-in-time data identified forpreservation if need be.

The data preservation function establishes the data preservationrelationship 230 for a track set of the source storage device 200 andthe target storage device 210 without immediately initiating a physicalcopy of point-in-time data from the source storage device 200 to thetarget storage device 210. Hence, the space made available on the targetstorage device 210 pursuant to the relationship 230 provides space forpossible future writes up to the entire set of point-in-time dataidentified for preservation if need be.

The space made available on the target storage device 210 in associationwith the relationship 230 is actually used in response to a request towrite new data to update old point-in-time data stored on the sourcestorage device 200 and within the relationship 230. If any writeactivity is initiated to update a portion of the identified set ofpoint-in-time data on the source volume, the write to the source volumeis temporarily blocked while that particular old point-in-time data isfirst transferred to the target volume (FIG. 2 c) for preservation aheadof the subsequent update. Thus, in the example of FIG. 2 c, a writeoperation is requested to update the point-in-time data stored on thetracks 250 c of the source storage device 200, resulting in a collision.Accordingly, the point-in-time data on tracks 250 c is physically copiedto tracks 260 of the target volume. After the transfer of that oldpoint-in-time data from source storage device tracks 250 c to targetstorage device tracks 260 completes, the write to the source storagedevice tracks 250 c to update the now copied old data is allowed (FIG. 2d) to complete.

The remaining tracks 250 a, 250 b of the point-in-time data remainuncopied since they have not been updated to this point. Thus, thepoint-in-time data physically copied to the target storage device 210 islimited in this mode, to the point-in-time data of the source storagedevice which was updated.

FIG. 3 illustrates an example of a hardware environment in whichembodiments in accordance with the present description may beimplemented. A plurality of host systems 310 a, 310 b, 310 c are in datacommunication with a storage area network (SAN) 311 which includes aplurality of storage devices such as hard disk storage 312 and solidstate storage 314. The hosts 310 a, 310 b, 310 c communicate with thestorage devices 312, 314, via a storage controller 320 of the storagearea network 311.

The hard disk storage 312 may include multiple direct access storagedevices (DASDs) units for example. The solid state storage 314 mayinclude multiple Flash memory units, for example. In this embodiment,the solid state storage 314 has a substantially faster access time ascompared to that of the hard disk drive storage 312. It is appreciatedthat other types of storage may be used as well including tape drivestorage.

The host systems 310 a, 310 b, 310 c may be any suitable host system,such as, for example, a mainframe computer, workstations, etc.,including an operating system such as WINDOWS®, AIX®, UNIX®, MVS®, etc.AIX is a registered trademark of IBM; MVS is a trademark of IBM; WINDOWSis a registered trademark of Microsoft Corporation; and UNIX is aregistered trademark licensed by the X/Open Company LTD. A plurality ofchannel paths 322 a, 322 b, 322 c in the host systems 310 a, 310 b, 310c provide communication paths to the storage controller 320. The storagecontroller 320 and host systems 310 a, 310 b, 310 c may communicate viaany network or communication system known in the art, such as LAN,TCP/IP, ESCON®, SAN, SNA, Fibre Channel, SCSI, etc. ESCON is aregistered trademark of International Business Machines Corporation(“IBM”). The host system 310 a, 310 b, 310 c executes commands andreceives returned data along a selected channel 322 a, 322 b, 322 c. Thestorage controller 320 may issue commands to physically position theelectromechanical devices to write data to or read data from the harddrive storage 312 via a communication path 330 a. The storage controller320 may also issue commands to write data to or read data from the solidstate storage 314 via a communication path 330 b.

In accordance with one aspect of the present description, a plurality ofmaps are provided for a target storage device, in which each map mapsextent ranges of the map to corresponding target extent ranges ofstorage locations on the target storage device. Each map extent rangefor a particular map extent range of a particular map, can indicateusage of the particular map extent range by a relationship between asource extent range of storage locations on a source storage devicecontaining data to be preserved in the source extent range, and thetarget extent range mapped to the particular map extent range.

FIGS. 4 a-4 h show an example of an array 400 of maps which in thisembodiment are bitmaps BM1, BM2 . . . BM5 for a volume of a targetstorage device such as the hard drive storage 312 or solid state storage314, for example. Each bitmap BM1, BM2 . . . BM5 maps a map extent rangeto corresponding target extent ranges of tracks 0-150 on the targetstorage volume. Thus, for example, a map extent range 410 a of thebitmap BM1 maps to a corresponding target extent range 0-50 of tracks0-150 on the target storage volume. In addition, the drawing of the mapextent range 410 a indicates usage of the particular map extent range410 a by a relationship R1 between a source extent range of storagelocations on a source storage device containing data to be preserved inthe source extent range, and the target extent range of tracks 0-50mapped to the particular map extent range 410 a.

The particular relationship using a map extent range of a particularbitmap may be identified in any suitable manner. For example, a datastructure for the particular relationship may identify the particularbitmap containing the map extent range or ranges being used by thatrelationship. Alternatively, the relationship identification informationmay be stored in or with the bitmap. It is appreciated that othertechniques may be used depending upon the particular application.

To illustrate operation of the array 400 of bitmaps as depicted in FIGS.4 a-4 h, FIG. 5 lists in tabular form one example of a series of eventsin which relationships are established and withdrawn for a particularsource volume and target volume. Relationships may be established inresponse to a data preservation command identifying a source extentrange containing data to be preserved on the source storage device, andidentifying a target extent range on the target storage device. Thus, inthe example of FIG. 5, the relationship R1 between the source extentrange of source tracks 0-50 of the source volume, and the target extentrange of target tracks 0-50 of the target volume, is established, andusage of the map extent range 410 a corresponding to target extent rangeof target tracks 0-50, is indicated by the “R1” designation in thedrawing of the map extent range 410 a of bitmap BM1 of FIG. 4 a.Similarly, in response to a data preservation command, the relationshipR2 between the source extent range of the source volume tracks 51-100 ofthe source volume, and the target extent range of the target volumetracks 51-100 of the target volume, is established. Usage of the mapextent range 410 b of bitmap BM1 is indicated by the “R2” designation inthe drawing of the map extent range 410 b of bitmap BM1 of FIG. 4 a.Likewise, in response to a data preservation command, the relationshipR3 between the source extent range of the source volume tracks 101-150of the source volume, and the target extent range of the target volumetracks 101-150 of the target volume, is established. Usage of the mapextent range 410 c of bitmap BM1 is indicated by the “R3” designation inthe drawing of the map extent range 410 c of bitmap BM1 of FIG. 4 a.

In the example of FIG. 4 a, the remaining bitmaps BM2-BM5 associatedwith the target volume are not yet in use by any relationships.Accordingly, the status of the map extent ranges of the bitmaps BM2-BM5are depicted as available or unoccupied as indicated by horizontal linehatching in the drawing of FIG. 4 a.

In the example of FIG. 5, following the establishment of relationshipsR1-R3, the relationship (which is the relationship R1) for target volumetracks 0-50 is subsequently to be withdrawn as shown in FIG. 5. However,before the relationship for target volume tracks 0-50 may be deleted,various clean up operations may need to be performed. For example, insome embodiments, selected data within the target volume tracks 0-50 isto be copied to other target volumes or other target tracks for olderrelationships that may inherit data from the target volume tracks 0-50in connection with a data deduplication process, for example. It isappreciated that types of “clean up” operations may cause a delay indeleting a relationship in response to a withdrawal command or followingother relationship ending events. Accordingly, if clean up operationsare to be performed before a relationship may be deleted, the map extentrange 410 may be changed to indicate a “to be deleted” status as shownin FIG. 4 b. In the drawing of FIG. 4 b, a “to be deleted” status isindicated by diagonal hatching.

The particular state or status of a map extent range (such as “in use”,“to be deleted”, or “available”) may be identified in any suitablemanner. For example, the status identification information may be storedin or with the bitmap or in a separate data structure, for example. Inone embodiment, a bitmap map extent may indicate one of two states,either available or unavailable (that is, already in use by arelationship which may be either active or to be deleted). In otherembodiments, additional states may be indicated such as available, inuse by an active relationship, and in use by a “to be deleted”relationship, for example. It is appreciated that other techniques maybe used depending upon the particular application.

As previously mentioned, by providing a plurality of maps for a targetstorage device, in which each map, maps extent ranges of the map tocorresponding target extent ranges of storage locations on the targetstorage device, a new relationship which encompasses tracks of a priorrelationship may be initiated before withdrawal of the priorrelationship is completed and the prior relationship is deleted. As aconsequence, establishment of new relationships may be facilitated.

In another aspect of the present description, in establishing arelationship in response to a data preservation command which identifiesa target extent range, the storage system determines whether any mapindicates availability of a map extent range mapped to the identifiedtarget extent range of the command. If it is determined that aparticular map indicates availability of a map extent range mapped tothe identified target extent range, the relationship between theidentified source extent range and the identified target extent range isestablished. Furthermore, the usage of the particular map extent rangeof the particular map by the particular relationship is indicated asdescribed above.

Conversely and in another aspect of the present description, upondetermining that no map indicates availability of a map extent rangemapped to the identified target extent range of a data preservationcommand, the establishing of a relationship between source extent rangeand the target extent range of the command is delayed. Once it isdetermined that a map indicates availability of a map extent rangemapped to the identified target extent range, the requested relationshipmay be established.

Thus, in the example of FIG. 4 b, the map extent ranges 410 a, 410 b,410 c of bitmap BM1 indicate in FIG. 4 b that map extent ranges 410 a,410 b, 410 c of bitmap BM1 are unavailable for new relationships. Morespecifically, the “to be deleted” relationship R1 is still using the mapextent range 410 a which is mapped to target extent range 0-50. Inaddition, the active or non-withdrawn relationships R2 and R3 are stillusing the map extent ranges 410 b, 410 c, respectively, which are mappedto target extent ranges 51-100, 101-150, respectively.

FIG. 6 depicts one example of operations of a storage system inaccordance with one embodiment of the present description, in which mapextent ranges may be examined for availability for use in establishingnew relationships. In one operation, in response to a data preservationcommand, a request is received (block 600) to establish a copyrelationship between a source extent range and a target extent range.Thus, following withdrawal of the relationship for target extent rangetracks 0-50, the system may receive, for example, a request to establisha new relationship between source extent range tracks 0-20 and targetextent range tracks 0-20, designated relationship R4 in FIG. 5.

In response to the request to establish relationship R4, the storagesystem determines whether any map indicates availability of a map extentrange mapped to the target extent range identified by the relationshiprequest. In the embodiment of FIG. 6, the system selects (block 610) abitmap associated with the target volume. Thus, the system couldinitially select bitmap BM1, for example.

In another operation, the selected bitmap may be examined (block 620) todetermine (block 630) if any part of the requested extent range of theselected bitmap is already being used by another relationship. In theexample of FIG. 4 b, the map extent range 410 a of bitmap BM1 indicatesin FIG. 4 b that map extent range 410 a which includes the map extentrange 0-20 is unavailable for new relationships. More specifically, the“to be deleted” relationship R1 is still using the portion of map extentrange 410 a which is mapped to target extent range 0-20.

Upon determining (block 630) that the selected bitmap is already beingused for at least a part of the requested target extent range of the newrelationship, a determination (block 640) is made as to whether all thebitmaps associated with the target volume have been examined. If not,another bitmap for the target volume is selected (block 650) and thatnext bitmap is examined (block 620) in the same manner as the previouslyselected bitmap BM1. Thus, a determination (block 630) is made as towhether any part of the requested extent range of the selected bitmap isalready being used by another relationship.

In the embodiment of FIG. 6, the system may next select (block 650),bitmap BM2, for example. The selected bitmap BM2 may be examined (block620) to determine (block 630) if any part of the map extent range of thebitmap BM2 corresponding to the requested target extent range 0-20 isalready being used by another relationship. In the example of FIG. 4 a,the map extent range 430 of bitmap BM2 indicates in FIG. 4 a that mapextent range 430 of bitmap BM2 which includes the map extent range 0-20is available for new relationships.

If it is determined that a particular map indicates availability of amap extent range mapped to the identified target extent range of the newrelationship request, the new requested relationship between theidentified source extent range and the identified target extent range isestablished. Furthermore, the usage of the particular map extent rangeof the particular map by the new relationship is indicated. In theembodiment of FIG. 6, the bitmap table is updated (block 660) for theselected bitmap to indicate that the requested map extent range of theselected bitmap is being used by the new relationship. Thus, in thisexample, the bitmap BM2 is updated in FIG. 4 b to indicate usage of themap extent range tracks 0-20 of the map extent range 430 a of the bitmapBM2, by the new relationship R4.

In addition, an index value of the selected bitmap may be stored (block670) in a relationship entry data structure for the new relationship.Thus, in this example, an index value of “2”, for example, for theselected bitmap BM2, may be stored (block 670) in a relationship entry710 (FIG. 7) of a table 720 of relationship data structures, for the newrelationship R4, to identify that the relationship R4 is using bitmapBM2. FIG. 7 also depicts data structures for the relationships R1, R2,R3 discussed above, which indicate that relationships R1, R2, R3 areusing bitmap BM1 as discussed above and depicted in FIGS. 4 a, 4 b.

Thus, it is seen from the above example that although the clean upoperation involving relationship R1 has not yet completed, a newrelationship, R4, may be established for a target extent range whichincludes some or all of the target extent range associated with theprior relationship R1 which is in the process of being withdrawn but notyet deleted. Accordingly, the new relationship R4 may be establishedwithout waiting for the prior withdrawn relationship R1 to be deleted.

In the example of FIG. 5, the next event is a request to establishrelationship R5 for target extent range tracks 21-40. In the same manneras described above, a map extent range in bitmap BM2 for target extentrange tracks 21-40 is identified as available (FIG. 4 a) and thus thebitmap BM2 is updated in FIG. 4 b to indicate usage of the map extentrange tracks 21-40 of the map extent range 430 b of the bitmap BM2, bythe new relationship R5. A data structure for the relationship R5 mayalso be updated to indicate that the relationship R5 is using the bitmapBM2.

The next event (FIG. 5) is a request to withdraw the relationship fortarget extent range tracks 51-150. FIG. 8 depicts one embodiment ofoperations of a storage system for withdrawing relationships between asource volume and a target volume. In a first operation, a request towithdraw a relationship between a source extent range and a targetextent range is received (block 800). In another operation, the bitmapfor the relationship to be withdrawn is identified (block 810). In oneembodiment, the bitmap may be identified by examining the datastructures of the table 700 (FIG. 7), for example. Thus, in the examplein which a request is received to withdraw the relationship for targetextent range tracks 51-150, table 700 indicates that bitmap BM1 is beingused by relationships R2 and R3 for target extent range tracks 51-150.

Alternatively, the bitmap may be identified by examining the bitmaptable of FIG. 4 b, for example. Thus, in the example in which a requestis received to withdraw the relationship for target extent range tracks51-150, the bitmap table indicates that bitmap BM1 is being used byrelationships R2 and R3 for target extent range tracks 51-150.

In another operation, the bitmap table for the identified bitmap isupdated (block 820) to indicate that the requested extent range of theidentified bitmap is to be deleted upon completion of the clean upoperation. Thus, in the example in which the bitmap BM1 is indicated tobeing used by relationships (here, relationships R2 and R3) for targetextent range tracks 51-150, the bitmap BM1 is updated to indicate thatthe relationships (here, relationships R2 and R3) for target extentrange tracks 51-150 are “to be deleted” as indicated by the diagonalhatching of map extent ranges 410 b, 410 c in FIG. 4 c.

As previously noted, in some embodiments, before a relationship fortarget volume tracks may be deleted, various clean up operations are tobe performed. For example, in some embodiments, selected data within thetarget extent range tracks may be copied (block 830) to other targetvolumes or other target tracks for older relationships that may inheritdata from target extent range tracks. Until it is determined (block 840)that any clean up operation has completed, the clean up operationcontinues (block 830).

The operations of the storage system continue in accordance with thedescription above for the subsequent events of FIG. 5. Thus, FIG. 4 cshows that in response to requests for establishment of relationshipsR6, R7 for target extent range tracks 41-130, 131-150, respectively,bitmap BM2 is determined to have available (FIG. 4 b) map extent rangesfor target extent range tracks 41-130, 131-150, respectively, andaccordingly, map extent ranges 430 c and 430 d, respectively, for bitmapBM2 are updated (FIG. 4 c) to indicate usage of those map extent ranges430 c and 430 d of bitmap BM2 by relationships (here, relationships R6,R7, respectively). In addition, data structures for relationships R6, R7are updated to indicate that the relationships R6, R7 are using bitmapBM2.

FIG. 4 d shows that in response to a request to withdraw therelationships for target extent range tracks 0-150, the bitmap BM2 isidentified as being used by the relationships R4-R7 for target extentrange tracks 0-150, and the bitmap table for the identified bitmap BM2is updated to indicate that the relationships (here, relationshipsR4-R7) for BM2 map extent ranges mapped to target extent range tracks0-150 are “to be deleted” as indicated by the diagonal hatching of mapextent ranges 430 a-430 d in FIG. 4 d.

FIG. 4 d further shows that in response to a request for establishmentof relationship R8 for target extent range tracks 0-150, bitmap BM3 isdetermined to have available (FIG. 4 c) map extent range 440 for targetextent range tracks 0-150, and accordingly, map extent range 440, forbitmap BM3 is updated (FIG. 4 d) to indicate usage of that map extentrange 440 of bitmap BM3 by a relationship (here, relationship R8). Inaddition, data structures for relationship R8 are updated to indicatethat the relationship R8 is using bitmap BM3.

FIG. 4 e shows that in response to a subsequent request to withdraw therelationships for target extent range tracks 0-150, the bitmap BM3 isidentified as being used by the a relationship (here, relationship R8)for target extent range tracks 0-150, and the bitmap table for theidentified bitmap BM3 is updated to indicate that the relationship(here, relationship R8) for target extent range tracks 0-150 is “to bedeleted” as indicated by the diagonal hatching of map extent range 440in FIG. 4 e.

FIG. 4 e further shows that in response to a request for establishmentof relationships R9-R12 for target extent range tracks 0-150(collectively) bitmap BM4 is determined to have available (FIG. 4 d) mapextent range 450 for target extent range tracks 0-150, and accordingly,map extent ranges 450 a, 450 b, 450 c, 450 d for bitmap BM4 are updated(FIG. 4 e) to indicate usage of those map extent ranges of bitmap BM4 byrelationships (here, relationships R9-R12). In addition, data structuresfor relationships R9-R12 are updated to indicate that the relationshipsR9-R12 are using bitmap BM4.

FIG. 4 f shows the bitmap BM4 updated to indicate that the relationships(here, relationships R9-R12) for target extent range tracks 0-150 are“to be deleted” as indicated by the diagonal hatching of map extentrange 450 a, 450 b, 450 c, 450 d, in response to a request to withdrawthe relationships for target extent range tracks 0-150. Bitmap BM5 ofFIG. 4 f shows usage of that bitmap by relationships (here relationshipsR13-R14) which were subsequently withdrawn as well and are to be deletedas indicated by the diagonal hatching of map extent ranges 460 a, 460 bof bitmap BM5 in FIG. 4 f.

In the example of FIG. 5, the next event (following the withdrawal ofthe relationships R13-R14) is a request to establish relationship R15for target extent range tracks 0-100. In the same manner as describedabove, the bitmaps BM1-BM5 are examined to determine if any of thebitmaps has an available map extent range which includes the targetextent range tracks 0-100. However, as shown in FIG. 4 f, although allof the prior relationships have been withdrawn, no bitmap is availablebecause the relationships using those bitmaps have not yet been deleted.If it is determined (block 640, FIG. 6) that all bitmaps are unavailablefor the requested target extent range, a “try later” is returned (block680, FIG. 6).

As previously noted, before a relationship for target volume tracks maybe deleted, various clean up operations may need to be performed. Forexample, in some embodiments, selected data within the target extentrange tracks may be copied (block 830, FIG. 8) to other target volumesor other target tracks for older relationships that may inherit datafrom target extent range tracks. If it is determined (block 840) thatthe clean up operation for a particular relationship has not completed,the clean up operation is permitted to continue (block 830).

However, once it is determined (block 840) that the clean up operationhas completed for a relationship being withdrawn, the relationship maybe deleted. Hence, the bitmap and data structure tables may be updated(block 850) for the selected bitmap for that relationship to indicatethat the map extent range corresponding to the target extent range ofthe withdrawn relationship is no longer being used by the withdrawn andnow deleted relationship. Thus, if clean-up operations for relationshipsR1-R2 have completed, the map extent range 410 d of bitmap BM1 fortarget extent range tracks 1-100 may be updated to indicate that the mapextent range 410 d (which combines map extent ranges 410 a, 410 b) isavailable for use by another relationship, as indicated by thehorizontal hatching in FIG. 4 g. In addition, the data structures forthe relationships R1-R2 may be updated to indicate that therelationships R1-R2 are no longer using the bitmap BM1.

In the example of FIG. 5, the next event is a retry of the request toestablish relationship R15 for target extent range tracks 0-100. In thesame manner as described above, the bitmaps BM1-BM5 are examined todetermine if any of the bitmaps has an available map extent range whichincludes the target extent range tracks 0-100. As noted above, the mapextent range 410 d of bitmap BM1 for target extent range tracks 1-100has been subsequently updated to indicate that the map extent range 410d is available for use by another relationship, as indicated by thehorizontal hatching in FIG. 4 g. Hence, FIG. 4 h shows that in responseto the retry of the request for establishment of relationship R15 fortarget extent range tracks 0-100, bitmap BM1 is determined to haveavailable (FIG. 4 g) map extent range 410 d for target extent rangetracks 0-100, and accordingly, map extent range 410 d, for bitmap BM1 isupdated (FIG. 4 h) to indicate usage of that map extent range 410 d ofbitmap BM1 by relationship R15. In addition, data structures forrelationship R15 are updated to indicate that the relationship R15 isusing bitmap BM1.

As operations continue additional clean up operations may completepermitting the associated relationships to be deleted. Accordingly, thebitmap table may be updated (block 850) for the selected bitmap for thedeleted relationship, to indicate that the map extent rangecorresponding to the target extent range of the withdrawn and nowdeleted relationship is no longer being used by that deletedrelationship. Thus, once clean-up operations for relationships R5 and R7have completed, for example, the map extent ranges 430 b and 430 d ofbitmap BM2 for target extent range tracks 0-40 and 131-150, respectivelymay be updated to indicate that the map extent ranges 430 b and 430 d ofbitmap BM2 are available for use by another relationship, as indicatedby the horizontal hatching in FIG. 4 h. In addition, the data structuresfor the relationships R5 and R7 may be updated to indicate that therelationships R5 and R7 are no longer using the bitmap BM2.

In the illustrated embodiment, five bitmaps BM1-BM5 are depicted for usewith a target volume. However, it is appreciated that the number ofbitmaps may vary, depending upon the particular application. Thus, forexample, in some embodiments, eight bitmaps may be used. It isappreciated that in some embodiments, a greater number of bitmaps maypermit establishment of more relationships, yet may delay clean upoperations following withdrawal of relationships.

Additional Embodiment Details

The described operations may be implemented as a method, apparatus orcomputer program product using standard programming and/or engineeringtechniques to produce software, firmware, hardware, or any combinationthereof. Accordingly, aspects of the embodiments may take the form of anentirely hardware embodiment, an entirely software embodiment (includingfirmware, resident software, micro-code, etc.) or an embodimentcombining software and hardware aspects that may all generally bereferred to herein as a “circuit,” “module” or “system.” Furthermore,aspects of the embodiments may take the form of a computer programproduct embodied in one or more computer readable medium(s) havingcomputer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, interconnected storage devices, anarray of storage devices, multiple memory or storage devices or anysuitable combination of the foregoing. In the context of this document,a computer readable storage medium may be any tangible medium that cancontain, or store a program for use by or in connection with aninstruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including, but not limited to,electro-magnetic, optical, or any suitable combination thereof. Acomputer readable signal medium may be any computer readable medium thatis not a computer readable storage medium and that can communicate,propagate, or transport a program for use by or in connection with aninstruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wireline, optical fiber cable, RF, etc., or any suitable combination ofthe foregoing.

Computer program code for carrying out operations for aspects of thepresent invention may be written in any combination of one or moreprogramming languages, including an object oriented programming languagesuch as Java, Smalltalk, C++ or the like and conventional proceduralprogramming languages, such as the “C” programming language or similarprogramming languages. The program code may execute entirely on theuser's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Aspects of the present invention are described below with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer,other programmable data processing apparatus, or other devices to causea series of operational steps to be performed on the computer, otherprogrammable apparatus or other devices to produce a computerimplemented process such that the instructions which execute on thecomputer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

In certain embodiments, the system of FIG. 3 may be implemented as acloud component part in a cloud computing environment. In the cloudcomputing environment, the systems architecture of the hardware andsoftware components involved in the delivery of cloud computing maycomprise a plurality of cloud components communicating with each otherover a network, such as the Internet. For example, in certainembodiments, the system of FIG. 3 may provide clients, and other serversand software and/or hardware components in the networked cloud, withscheduling services.

The terms “an embodiment”, “embodiment”, “embodiments”, “theembodiment”, “the embodiments”, “one or more embodiments”, “someembodiments”, and “one embodiment” mean “one or more (but not all)embodiments of the present invention(s)” unless expressly specifiedotherwise.

The terms “including”, “comprising”, “having” and variations thereofmean “including but not limited to”, unless expressly specifiedotherwise.

The enumerated listing of items does not imply that any or all of theitems are mutually exclusive, unless expressly specified otherwise.

The terms “a”, “an” and “the” mean “one or more”, unless expresslyspecified otherwise.

Devices that are in communication with each other need not be incontinuous communication with each other, unless expressly specifiedotherwise. In addition, devices that are in communication with eachother may communicate directly or indirectly through one or moreintermediaries.

A description of an embodiment with several components in communicationwith each other does not imply that all such components are required. Onthe contrary a variety of optional components are described toillustrate the wide variety of possible embodiments of the presentinvention.

Further, although process steps, method steps, algorithms or the likemay be described in a sequential order, such processes, methods andalgorithms may be configured to work in alternate orders. In otherwords, any sequence or order of steps that may be described does notnecessarily indicate a requirement that the steps be performed in thatorder. The steps of processes described herein may be performed in anyorder practical. Further, some steps may be performed simultaneously.

When a single device or article is described herein, it will be readilyapparent that more than one device/article (whether or not theycooperate) may be used in place of a single device/article. Similarly,where more than one device or article is described herein (whether ornot they cooperate), it will be readily apparent that a singledevice/article may be used in place of the more than one device orarticle or a different number of devices/articles may be used instead ofthe shown number of devices or programs. The functionality and/or thefeatures of a device may be alternatively embodied by one or more otherdevices which are not explicitly described as having suchfunctionality/features. Thus, other embodiments of the present inventionneed not include the device itself.

The illustrated operations of FIGS. 6, 8 show certain events occurringin a certain order. In alternative embodiments, certain operations maybe performed in a different order, modified or removed. Moreover, stepsmay be added to the above described logic and still conform to thedescribed embodiments. Further, operations described herein may occursequentially or certain operations may be processed in parallel. Yetfurther, operations may be performed by a single processing unit or bydistributed processing units.

The foregoing description of various embodiments of the invention hasbeen presented for the purposes of illustration and description. It isnot intended to be exhaustive or to limit the invention to the preciseform disclosed. Many modifications and variations are possible in lightof the above teaching. It is intended that the scope of the invention belimited not by this detailed description, but rather by the claimsappended hereto. The above specification, examples and data provide acomplete description of the manufacture and use of the composition ofthe invention. Since many embodiments of the invention can be madewithout departing from the spirit and scope of the invention, theinvention resides in the claims hereinafter appended.

1. A method, comprising: mapping in a plurality of maps for a targetstorage device, map extent ranges of each map, to corresponding targetextent ranges of storage locations on the target storage device; andindicating for a particular map extent range of a particular map, usageof the particular map extent range by a relationship between a sourceextent range of storage locations on a source storage device containingdata to be preserved in the source extent range, and the target extentrange mapped to the map particular extent range.
 2. The method of claim1, further comprising: receiving a data preservation command identifyinga source extent range containing data to be preserved on the sourcestorage device, and identifying a target extent range on the targetstorage device; in response to the command, performing a datapreservation operation including: determining whether a map indicatesavailability of a map extent range mapped to the identified targetextent range; and upon determining that a particular map indicatesavailability of a map extent range mapped to the identified targetextent range, establishing a relationship between the identified sourceextent range and the identified target extent range; wherein saidindicating further includes indicating usage of the particular mapextent range of the particular map by the relationship.
 3. The method ofclaim 2, further comprising: storing in a data structure for therelationship, an identification of the particular map which indicatesusage of the particular map extent range of the particular map by therelationship.
 4. The method of claim 2, further comprising: upondetermining that no map indicates availability of a map extent rangemapped to the identified target extent range, delaying establishing arelationship between the identified source extent range and theidentified target extent range until it is determined that a particularmap indicates availability of a map extent range mapped to theidentified target extent range.
 5. The method of claim 3 furthercomprising: withdrawing the relationship; copying data within theidentified target extent range of the withdrawn relationship, to olderrelationships inheriting the data being copied.
 6. The method of claim 5further comprising: upon completion of the copying of data within theidentified target extent range of the withdrawn relationship, to olderrelationships inheriting the data being copied, indicating for theparticular map extent range of the particular map, availability of theparticular map extent range for usage by another relationship between asource extent range of storage locations on a source storage devicecontaining data to be preserved in the source extent range, and thetarget extent range of the withdrawn relationship.
 7. A computer programproduct, for use with a host, a storage controller and source and targetstorage devices having extent ranges, the computer program productcomprising a computer readable storage medium having computer readableprogram code embodied therein that executes to perform operations, theoperations being in the storage controller, the operations comprising:mapping in a plurality of maps for a target storage device, map extentranges of each map, to corresponding target extent ranges of storagelocations on the target storage device; and indicating for a particularmap extent range of a particular map, usage of the particular map extentrange by a relationship between a source extent range of storagelocations on a source storage device containing data to be preserved inthe source extent range, and the target extent range mapped to the mapparticular extent range.
 8. The computer program product of claim 7,wherein the operations further comprise: receiving a data preservationcommand identifying a source extent range containing data to bepreserved on the source storage device, and identifying a target extentrange on the target storage device; in response to the command,performing a data preservation operation including: determining whethera map indicates availability of a map extent range mapped to theidentified target extent range; and upon determining that a particularmap indicates availability of a map extent range mapped to theidentified target extent range, establishing a relationship between theidentified source extent range and the identified target extent range;wherein said indicating further includes indicating usage of theparticular map extent range of the particular map by the relationship.9. The computer program product of claim 8, wherein the operationsfurther comprise: storing in a data structure for the relationship, anidentification of the particular map which indicates usage of theparticular map extent range of the particular map by the relationship.10. The computer program product of claim 8, wherein the operationsfurther comprise: upon determining that no map indicates availability ofa map extent range mapped to the identified target extent range,delaying establishing a relationship between the identified sourceextent range and the identified target extent range until it isdetermined that a particular map indicates availability of a map extentrange mapped to the identified target extent range.
 11. The computerprogram product of claim 9 wherein the operations further comprise:withdrawing the relationship; copying data within the identified targetextent range of the withdrawn relationship, to older relationshipsinheriting the data being copied.
 12. The computer program product ofclaim 11 wherein the operations further comprise: upon completion of thecopying of data within the identified target extent range of thewithdrawn relationship, to older relationships inheriting the data beingcopied, indicating for the particular map extent range of the particularmap, availability of the particular map extent range for usage byanother relationship between a source extent range of storage locationson a source storage device containing data to be preserved in the sourceextent range, and the target extent range of the withdrawn relationship.13. A system for use with a host, comprising: source and target storagedevices having extent ranges; and a storage controller adapted tocontrol the source and target storage devices, said storage controllerincluding a processor which is adapted to perform operations including:mapping in a plurality of maps for a target storage device, map extentranges of each map, to corresponding target extent ranges of storagelocations on the target storage device; and indicating for a particularmap extent range of a particular map, usage of the particular map extentrange by a relationship between a source extent range of storagelocations on a source storage device containing data to be preserved inthe source extent range, and the target extent range mapped to the mapparticular extent range.
 14. The system of claim 13, wherein theoperations further comprise: receiving a data preservation commandidentifying a source extent range containing data to be preserved on thesource storage device, and identifying a target extent range on thetarget storage device; in response to the command, performing a datapreservation operation including: determining whether a map indicatesavailability of a map extent range mapped to the identified targetextent range; and upon determining that a particular map indicatesavailability of a map extent range mapped to the identified targetextent range, establishing a relationship between the identified sourceextent range and the identified target extent range; wherein saidindicating further includes indicating usage of the particular mapextent range of the particular map by the relationship.
 15. The systemof claim 14, wherein the operations further comprise: storing in a datastructure for the relationship, an identification of the particular mapwhich indicates usage of the particular map extent range of theparticular map by the relationship.
 16. The system of claim 14, whereinthe operations further comprise: upon determining that no map indicatesavailability of a map extent range mapped to the identified targetextent range, delaying establishing a relationship between theidentified source extent range and the identified target extent rangeuntil it is determined that a particular map indicates availability of amap extent range mapped to the identified target extent range.
 17. Thesystem of claim 15 wherein the operations further comprise: withdrawingthe relationship; copying data within the identified target extent rangeof the withdrawn relationship, to older relationships inheriting thedata being copied.
 18. The system of claim 17 wherein the operationsfurther comprise: upon completion of the copying of data within theidentified target extent range of the withdrawn relationship, to olderrelationships inheriting the data being copied, indicating for theparticular map extent range of the particular map, availability of theparticular map extent range for usage by another relationship between asource extent range of storage locations on a source storage devicecontaining data to be preserved in the source extent range, and thetarget extent range of the withdrawn relationship.